TRANSLATION OF SPECIFICATION OF JAPANESE PATENT PUBLICATION 
TOKKAI 61-150080 

SPECIFICATION 

1 . Title of the Invention 
Defect detection method 

2. Claim 

A defect detection method characterized as photographing a target detection area, 
storing detection contents by preliminarily determined detection forms such as gradation, 
detecting a boundary of the target detection area, setting an inspection reference position 
separate from by a preliminarily determined displacement quantity from aforementioned 
boundary and parallel to aforementioned boundary at a time when a defect, etc. are 
assumed, comparing mutually aforementioned detection contents at a pair of positions 
symmetric to each other with respect to a preliminarily determined position along this 
inspection reference position, and detection magnitude of defect, etc. based on results of 
this comparison. 

3. Detailed description of the invention 
Field of technology 

This invention relates to a method of detecting defects such as cracks and missing 
parts on the surface of a target object based on image data obtained by photographing the 
target object. 

Background 

There have been methods of detecting defects in the shape of a target object such 
as cracks and missing parts by image processing. According to a conventional 
technology, the target object is photographed by means of a television camera, the image 
signals from the television camera are digitalized, storing the digitalized image data in an 
image memory and carrying out a calculation process on the stored image data to detect 
the defects of the target object. 

For this image processing in order to detect defects, the pattern recognition of a 
density image becomes necessary. A line picture is obtained with edges that are the 
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contour of the target object based on an original image obtained by photographing the 
target object, and a pattern in recognized by extracting characteristics of this line picture. 
Since edges are extracted from a density image by taking out changes in the density in the 
image, the differentiation method is usually employed. 

Fig. 7 is for explaining the differentiation method. Fig. 7(1) shows arbitrary 3x3 
pixels on the original image. If its reference symbols A-I are to indicate the density of 
each pixel, the differential AV of the pixel with density E in the perpendicular direction is 
shown by Formula 1 given below and its differential AH in the horizontal direction is 
shown by Formula 2 given below. 

AV = (G+H+I)-(A+B+C) (1) 

AH = (C+F+I)-(A+D+G) (2) 

If this is so, the differential value I e| of the pixel with density E is given b y 
Formula 3 given below. 

Id ={(AV) 2 +(AH) 2 } 1/2 (3) 

And the differential direction Ze at this pixel E can be expressed as shown by 
Formula 4 given below. 

Ze = tan-l(AV/AH) + nil (4) 

A differential image and differential direction on such image can be obtained if 
such operations are carried out on all of the pixels on the original image. 

Next, the edge extraction process is explained. Fig. 7(2) shows differential values 
I a| -|i| of each of arbitrary 3x3 pixels on a differential image. The pixel with 
differential value I d will be considered, and the two differential values in the direction of 
90 degrees with respect to differential direction Ze will be compared with the differential 
value of the aforementioned pixel. Only if this differential value I d is larger than the 
two neighboring differential values, an edge flag will be raised at the address 
corresponding to the aforementioned pixel on the edge extraction image. If I d i is the 
threshold value of the differential value I d and I d 2 is the differential value in the 



2 



perpendicular direction with respect to the differential direction of that pixel, the edge 
flag can be raised if Formula 5 given below is satisfied. 

Mi <N >N 2 (5) 

An edge line extraction image is obtained by carrying out this process on all of 
the pixels. 

Deformation of edge line is obtained for learning the condition of defect from the 
edge line extraction image thus obtained. According to the conventional technology, the 
angular difference with the row-column address of the adjacent next edge flag by the 
row-column address of the aforementioned edge flag and the degree of deformation is 
obtained from the size of this angle. Although the degree of deformation of an edge line 
can detected by such a method, it is difficult to detect the magnitude of this change which 
indicates the area of the defect. 

Object 

It is an object of this invention to provide a defect detection method capable of 
speedily and accurately detecting defects such as cracks and missing parts that occur on 
the surface of a target object for detection. 

Embodiments 

Fig. 1 is a block diagram which shows the structure of an image processing 
device capable of carrying out this invention. A target object for detection is 
photographed by an industrial television cameral. Analog signals, which are image data 
of the target object, are outputted from the industrial television camera 1 to an A/D 
converter 2. The A/D converter 2 converts the analog signals from the industrial 
television camera 1 into digital signals and transmits them to a differentiation circuit 3. 
This differentiation circuit 3 carries out the calculation processes shown by Formulas 1-4 
described in the background section, and the differential value I d corresponding to the 
grade difference of the pixel and the differential direction Ze of this pixel are obtained . 
This process is carried out individually for each pixel for the entire edge line. The 
differential value I el and its differential direction Ze obtained by the differentiation 
circuit 3 and the differential direction Ze are stored in a memory 4 and also outputted to 
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an edge line extraction circuit 5. The edge line extraction circuit 5 carries out a 
calculation process shown by Formula 5 based on the differential value I d and its 
differential direction Ze calculated by the differentiation circuit 3. The edge flag ef 
obtained by the calculation process by the edge line extraction circuit 5 is outputted to the 
memory 4 and stored. Regarding the edge line erased by the threshold value I d i in 
Formula 5, an edge line necessary for a specified evaluation calculation is regenerated 
from the end of the remaining edge line above this threshold value I d i by an edge line 
tracing circuit 6, and its value is outputted to the memory 4. Based on the data as 
described above, a process of extracting characteristics of edge is carried out by an image 
judgment circuit 7. The image judgment circuit 7 is comprised of a swap memory 8 that 
stores data such as original image data Z, differential value I d , differential direction Ze 
and the regenerated edge line, and a CPU (central processing unit) 9 for carrying out the 
characteristic extracting process based on the edge flag by these stored data and judging 
whether they are good or no good. A control circuit 10 is provided for setting the 
aforementioned threshold value and controlling the whole of this image processing 
device. 

Figs. 2-4 are referenced to explain the defect detection method of this invention. 
Fig. 4 is a block diagram of an example the defect detection method of this invention. It 
becomes as shown in Fig. 2(1) if the image of the target object of detection is processed 
by an image processing device as shown in Fig. 1 . In Fig. 2(1), symbol L indicates the 
edge line of the target object for which the edge flag was raised and an arrow indicates 
the direction of its differential direction Ze. The changed part of the edge line indicated 
by symbol K is a defective part of the target object. To start, an edge flag es for starting a 
scan and its differential direction data are extracted. Next, an address is added by 
displacing m pixels in a perpendicular direction with respect to the direction of the edge 
flag towards the interior or the target object. Thus, scan line LI with address added by 
displacing n pixels in the direction of the edge flag is obtained, as shown in Fig. 2(2). 
Scan line L2 is also obtained with address added by displacing n pixels in the direction 
opposite to the edge flag, as shown in Fig. 2(3). Scan line L3 is finally obtained as 
shown in Fig. 2(4) if the aforementioned addresses are synthesized. Fig. 3 shows section 
III of Fig. 2(4) enlarged. With P0 and PI indicating the crossing points of edge line L 
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and scan line L3, the following calculation is carried out with reference to these crossing 
points PO and PL Firstly, the address in point symmetry is obtained for each pixel in the 
direction of scan line L3 with respect to crossing point PO and the grade value Z of each 
of these addresses is extracted. Next, calculations shown below in Formula 6 and 
Formula 7 are carried out. 
AZi = Z a i - Zbl 



In the above, Z a i - Z an each indicate the gradation value of each of the pixels a i - 
an, Zbi - Zbn each indicate the gradation value of each of the pixels bi - bm and AZi - AZn 
each indicate the gradation difference. 

Each of the gradation differences AZi - AZn and their total ZAZn are calculated by 
Formula 6 and Formula 7. Next, the aforementioned total 2 AZn is compared with a 
predetermined threshold value and if it is larger than the threshold value, the target object 
is judged to be a defective produce having a defect. If it is less, it is judged to be a good 
product. 

Fig. 5 is a drawing for explaining another embodiment of this invention, and Fig. 
6 is a block diagram for explaining another example of defection detection method of this 
invention. Regarding this embodiment, an operation for detecting a defective part K 
generated at a corner of a target object for inspection, as shown in Fig. 5(1), is explained. 
Firstly, edge line E showing the outline of the target object for detection is obtained, as in 



the previously described embodiment. Section II of Fig. 5(1) is shown enlarged in Fig. 
5(2). As shown in Fig. 2(2) (sic), the straight portion of edge line E leading to the 
defective part K is extended and the peak point C in the situation without the defect is 
obtained. The address of this peak point C is obtained, and scan line S is set into the 
internal direction of the target object with this peak point C as its starting point. In this 
situation, scan line S coincides with the straight line bisecting the angle formed by the 
extended virtual lines El and E2 of edge line E and the peak point C. Thus, the pixel 
displaced on scan line S by m pixels along each of the extended virtual lines El and E2 



AZ2 — Z a 2 - Zb2 



(6) 




EAZn = AZi + AZ 2 + ... AZ„ 



(7) 
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from the peak point C as the starting point is scanned. Next, it is judged whether there is 
an edge flag present on scan line S from the scan starting point C. If an edge flag is 
present at the crossing point shown by symbol Q in Fig. 5(2) between edge line E of the 
target object and scan line S, a process as explained below is carried out. Fig, 5(3) is a 
drawing which shows Fig. 2 (sic) further enlarged. As shown in Fig. 5(3), gradation 
values Z a i - Z an 'and Z b i - Zb n of pixels a i - an and bi - bn at positions in point symmetry in 
the direction of scan line S with reference to the point indicated by symbol Q are 
obtained. Then, gradation differences AZi - AZn of the original image as shown by 
aforementioned Formula 6 are calculated based on these gradation values Z a i - Z an and 
Zbi - Zbn. A total value SAZn as shown by aforementioned Formula 7 by carrying out 
such calculations and based of the results of such calculations. Then, as in the previously 
described embodiment, the aforementioned total ZAZn is compared with a preliminarily 
determined threshold value and, if it is larger than the threshold value, it is judged that the 
target object is a defective product with a defect. If it is less, it is judged to be a good 
product. 

Although the gradation value was compared with respect to the reference point Q 
for each pixel according to the embodiment described above, the average gradation value 
of an area corresponding to a plurality of pixels may be compared. In this way, detection 
errors caused by dust, etc. can be prevented. 

Although the invention was carried out based on gradation pixels in the 
aforementioned embodiment, it may be carried out based on image data by a color image. 

Effects 

As described above, defects can be detected speedily and accurately according to 
this invention because a target object is photographed, the contents of detection are 
stored, a reference position for inspection is determined, the aforementioned detection 
contents at a pair of positions which are symmetric with respect to a preliminarily 
determined position along this reference position are mutually compared and the 
magnitude of the defect, etc. are detected based on the result of this comparison. 

4. Brief description of the drawings 
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Fig. 1 is a block diagram showing the structure of an example of image 
processing device capable of carrying out the present invention. Fig. 2 is a drawing for 
explaining a defect detection method according to an embodiment of this invention. Fig. 
3 is a drawing for explaining the detection method according to an embodiment of this 
invention in connection with Fig. 2. Fig. 4 is a block diagram showing a defect detecting 
method according to an embodiment of this invention. Fig. 5 is a drawing for explaining 
another embodiment of this invention. Fig. 6 is a block diagram for showing a defect 
detecting method according to another embodiment of this invention. Fig. 7 is a drawing 
for explaining an image processing method. 

1 : Industrial television camera 

2: Analog/digital converter 

3 : Differentiation circuit 

4: Memory 

5: Edge line extraction circuit 

6: Edge line tracing circuit 

7: Image judgment unit 

8: Swap memory 

9: CPU 

10: Control circuit 

E, L: Edge lines 

L1,L2, L3 ? S: Scan lines 
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